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TEST  PROCEDURES  FDR  TOLL  CALL  CERTIFICATION  ALTERNATIVES 


1.  PURPOSE:  Tto  present  recommended  procedures  to  be  used  in  the  evaluation  of 
alternative  approaches  for  certifying  toll  calls.  The  office  of  the 
comptroller  of  the  Army  { COA)  requested  that  test  procedures  to  evaluate  an 
alternative  to  the  current  precertification  of  long-distance  telephone  bills  be 
developed.  (Inference  letter,  COA,  DACA-FAP-PT,  22  Jul  86,  Request  for 
Establishment  of  Ttest  Procedures.) 


2.  BACKGROUND:  The  House  Appropriations  Ctmmittee  (HAC)  requested  proposals 
to  change  laws  that  will  provide  productivity  improvement.  00A  proposed  that  a 
change  be  made  to  Title  31,  United  States  Oode  Section  1348(b),  to  remove  the 
requirement  to  precertify  ccmmercial  long-distance  telephone  calls  before 
payment.  This  proposal  was  not  one  of  those  presented  to  the  HAC  for 
consideration,  but  the  COA  directed  that  it  be  evaluated,  even  though  its 
original  purpose  was  not  served.  On  advice  of  the  JAG  (end  1),  removal  of  the 
requirement  to  precertify  before  payment  is  illegal;  therefore,  the  COA 
proposed  procedures  (that  incorporated  the  elimination  of  the  precertification 
requirement)  could  not  be  tested.  In  its  plaoe,  the  practice  of  paying  on 
receipt  the  percentage  of  the  bill  representing  the  official  calls,  as  given  in 
the  decision  of  the  Comptroller  General  of  the  U.S.  (Decision  2179%)  (end 
2),  coupled  with  the  application  of  statistical  sampling  methods,  is  proposed 
as  the  alternative  to  be  evaluated. 


3.  TEST  DESCRIPTION: 

a.  The  testing  of  the  certification  process  alternatives  involves  a  cross 
section  of  CONUS  installations,  both  with  and  without  automated  message 
accounting  (AMA)  equipment,  and  at  large,  medium,  and  small  installations, 
namely.  Fort  Leonard  Wood,  Aberdeen  Proving  Ground,  Sacramento  Army  Depot,  Fort 
Riley,  Port  Sheridan,  and  Port  Hood.  Each  of  these  installations  was  requested 
to  provide  information  concerning  current  toll  call  certification  workload  and 
detection  of  unofficial  telephone  usage  (end  3).  The  percentages  reflecting 
unofficial  usage  are  so  low  that  the  sampling  approach  to  certification  is  very 
attractive.  It  should  be  noted  that  these  results  differ  significantly  from 
the  U.  S.  Army  Audit  Agency  report  (NE-86-4)  referenced  in  your  letter;  the 
Office  of  the  Inspector  General  DOD  proposed  audit  report,  project  51C-017 
dated  7  Jul  86  (end  4);  and  the  results  obtained  in  the  study  made  by  this 
office  (end  5).  The  explanation  for  this  marked  improvement  is  unknown  at 
this  time.  The  test  series  should  confirm  or  question  that  progress  has  been 
made . 

b.  Each  participating  installation  will: 

(1)  Implement  the  requirements  contained  in  the  draft  of  AR  25-7,  Chapter 
10  (appendix  A). 

(2)  Pay  on  or  just  before  the  due  date,  the  percentage  of  the  toll  call 
charges  that  are  adjudged  to  be  offical  based  upon  historical  records,  thereby 
limiting  the  late  charges  to  those  that  are  under  investigation;  then,  pay  for 
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the  remainder  of  the  toll  calls  in  subsequent  billings  together  with  any 
appropriate  late  charges. 

(3)  Stratify  the  toll  calls  listed  in  the  monthly  telephone  bill  into 
categories  that  require  different  levels  of  acceptability:  Check  higher  cost 
calls  on  a  100%  basis;  disregard  calls  with  insignificant  charges;  and  certify 
the  remaining  calls  on  a  sampling  basis,  if  there  are  more  than  150  calls  in 
this  category.  Charges  stem  frcm  a  combination  of  duration  of  the  call  and  the 
distance  involved.  It  is  reccrrmended  that  call  duration  be  used  for 
categorization . 

(4)  Apply  statistical  sampling  methods  in  the  certification  process  LAW 
appendix  B. 

4.  DATA  REQUIREMENTS: 


a.  Baseline  certification  experience.  Each  installation  should  provide 
historical  information  for  each  of  the  last  6  months,  such  as,  total  number  of 
toll  calls  listed  on  the  monthly  bill  and  the  total  of  the  charges;  the  number 
of  these  calls  that  were  questioned  because  they  were  not  official  the 
local  certification  requirements,  and  the  charges  for  these;  and  the  results  of 
follow-up  investigations  including  number  of  calls  and  charges  bounced  back  to 
the  telephone  company,  number  of  calls  and  charges  identified  to  the  originator 
and  collected.  This  information  establishes  the  percentage  that  is  to  be  used 
for  payment  of  the  telephone  toll  charges  to  avoid  late  charges.  Also  provide 
an  estimate  of  the  administrative  costs  involved  in  the  certification  process 
and  the  follow-up  of  questionable  calls  to  compare  with  these  costs  during  the 
conduct  of  the  test  series.  Note  also  if  the  telephone  bill  was  subject  to 
late  payment  charges  and  list  the  amounts  paid,  if  any. 

b.  Certification  experience  during  the  test  series.  Provide,  each  month, 
the  same  data  that  is  listed  for  the  baseline  period.  Also  describe  each 
unofficial  toll  call,  investigation  findings,  and  corrective  measures  taken  to 
preclude  recurrence. 

c.  Evidence  of  statistical  control.  Plot  sampling  results  on  a  fraction 
defective  control  chart  with  upper  control  limits  to  demonstrate  continued 
control  and  to  track  trends  for  management  visibility.  Figure  1  provides  a 
sample  control  chart  format.  Historical  data  establishes  the  central  value 
"p' "  of  the  "p-chart",  using  the  weighted  average  computation  formula  given 
below.  Upper  control  limits  (UCLs) ,  determined  frcm  the  following  equation, 
are  listed  in  table  1.  Vhen  the  monthly  determination  of  percentage  of 
unofficial  toll  calls  found  in  the  sample  exceeds  the  UCL,  there  is  a 
significant  departure  frcm  the  baseline  experience.  Variations  that  occur 
below  the  UCL  reflect  sampling  selection.  An  illustrative  example  is  given  in 
appendix  C: 


UCL  =  p’  +  31/p'U  -  p')/n  ', 

where  n  is  the  sample  size  for  the  month,  and 

p’  =  (nipi  +  n2P2  +  ••••  +  nkPk)/*nl  +  n2  +  ••••  +  n^), 

where  n^p^  and  i\  reflect  historical  data  from  the  kth  month. 


Table  1  provides  the  UCL  values  for  p'  values  of  0.001  through  0.100  and  the 
sample  sizes,  n,  for  all  sample  sizes  listed  in  appendix  B.  For  example,  if 
the  percentage  of  unofficial  toll  calls  during  the  baseline  period  of  the 
previous  6  months  is  5%  (p*  =  .050),  then  the  UCL  for  a  sample  of  125  is  10.8%, 
for  a  sample  of  13  is  23.1%,  etc. 

d.  Sampling  plan  usage  and  results.  Present  as  part  of  the  certification 
statement  that  authorizes  payment  of  the  telephone  bill,  a  description  of  the 
sampling  plan  used  and  the  results  obtained  to  permit  acceptance.  If  the  plan 
resulted  in  rejection,  describe  the  follow-up  action  taken. 

e.  Installations  that  are  equipped  with  AMA  have  an  opportunity  to 
determine  the  unofficial  use  of  other  telephone  systems  by  isolating 
questionable  calls,  such  as,  those  made  to  unusual  area  codes  and  telephone 
numbers,  calls  made  after  hours,  calls  of  extended  duration,  etc.  Follow-up 
investigation  of  these  suspicious  calls  may  correct  disciplinary  problems  and 
subsequently  lead  to  reduced  communication  costs. 


CONTROL  CHART  FOR  MONTHLY  PERCENTAGE  OF  UNOFFICIAL  TOLL  CALLS 
MIL-STD-105D  Single  Sampling  Plan  with  AQL  of  _ Z 


v> 


« 

.O  r-4 

o  h  4  a 

—4  —4  O  44 

m  nj  a.  m  ci 

cue  -4 

ft)  (ft  "O  44 

U  H  W  CM 
O  —4  3  0 

«  0  C  0  c 

C*.  H  •  U.  D 


M  J  0  3 

►  y  <w 

M  ••  D  ••  w 

n . 

-4  N  C  '  -4 

ft)  44  4J  w  0-4 

>  to  -4  as  is 
ft)  BO)  u 
»-)  e  44  n  «> 

O  1-3  44  (J  -4 

#0  44  VI  C  (ft 

C  M  -4  (SO' 

44  (ft  o  ft)  M  -4 

•—k  m-L  ia  •— ♦  Q.  L-J 

Q.  3  AJ  CL  <U 

B  &  C  B  O  O 

(ft  O  O  (ft  O  C 

010.0  0)0 


4.m  fc.a  i -t  ■ 


•t.i  ;.»  L|lrf,>-»*^-*'*->  *■«  »-*  * 


Table  1:  Upper  Oontrol  Limit  (UCL)  Percentages  for  Values  of  p'  in  the  tenge 
of  0.001  to  0.100  and  MIL-STD-105D  Sample  Sizes  up'to  200. 
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Chap  10 

10-11  Certification  of  Telephone  Toll  Calls 

a.  The  installation  commande r/DO I M  will  prepare  a 
certification  program  for  the  installation  or  activity  supported. 
Where  the  certification  has  MACOM-wide  application,  as  in  the 
recruiting  command,  the  DCIM/DOIM  may  perform  this  function. 

Such  a  program: 

(1)  Should  be  based  on  classes  of  certification  which 
are  related  to  the  degree  of  unrestricted  access  to  commercial 
long  distance  calling  (and  are  therefore  relative  to  the 
potential  for  abuse) . 

(2)  Should  be  concerned  with  overall  economy  and 
discipline  vice  a  singular  focus  on  long  distance  commercial 
calling. 

(3)  Should  have  the  flexibility  to  use  automation  and 
call  detail  recording  to  their  best  advantage  as  a  source  of 
management  information  and  internal  control. 

(4)  Should  be  localized  to  accommodate  technical, 
organizational,  or  geographic  characteristics  of  the  activity 
where  certification  occurs. 

(5)  Should  be  discretionary  (within  class  of 
certification  and  level  of  approval). 

(6)  Should  encourage  a  more  centralized,  economical 

certification  process;  one  that  can  reasonably  occur  at  the 
supporting  C  ^oer  level  based  on  periodic  contact  with 

telephone  control  officers  for  the  organizations  supported. 

(7)  Should  be  well  documented  IAW  the  format  described 
below  and  subject  to  periodic  review. 

b.  SCOPE.  The  telecommunications  certification  program 
serves  to: 

(1)  Provide  an  internal  and  operational  plan  for 
telecommunications  economy  and  discipline. 

(2)  Provide  the  policy  and  procedures  for  the 
verification/certification  of  telecommunications  expenses  to  be 
officially  certified  for  payment  on  SF  1034,  Public  Voucher  for 
Purchases  and  Services  Other  than  Personal. 

c.  The  certification  program  should  consist  of  four  levels 
of  review.  Requirements  to  develop  and  maintain  sufficient 
inventory  data  to  review  common-user  telecommunications 
requirements,  call  detail,  traffic  management,  and  for  bill 
verification  are  used  in  conjunction  with  the  certification 


program . 


(1)  For  each  installation  or  activity/  individualized 
procedures  will  be  developed  and  documents  for  all  levels  of 
review  in  the  certification  program.  These  levels  are: 

LEVEL  RESPONSIBLE  PARTY  WHEN  PERFORMED 

Basic  Certification  TCO  Continuous 

Performance  Certification  DOIM  Per  Telecom- 

or  Designee  munications  Bill 

Secondary  Certification  DOIM  Periodic 

or  Designee 

Remedial  Certification  TCO  and  DOIM  As  required 

(2)  Basic,  performance,  and  secondary  certification 
review  levels  are  mandatory.  Remedial  certification  is  performed 
when  abuse  is  judged  excessive.  Excessive  abuse  is  decided  on 
the  basis  of  usage  indicators  and  other  factors  which  are 
discussed  below. 

e.  PROCEDURES.  Certain  procedures  are  required  for  each 
level  of  certification.  The  minimum  requirements  are  provided 
below  for  an  appropriate  certification  program  to  include 
compliance  with  the  statutory  requirements  of  31  U.S.  Code 
1348(b).  More  detailed  or  stringent  procedures  may  be  imposed  by 
the  supporting  DOIM  who  develops  the  local  certification  program. 
Also,  inspection  or  compliance  reviews  by  either  USAISC  or 
supported  MACOM  may  change  these  procedures,  if  compliance  is  not 
satisfactory . 

f,  BASIC  CERTIFICATION.  Basic  certification  is  the 
acknowledgment  that  toll  and  other  long  distance  calls  are  made 
in  the  interest  of  government. 

(1)  Basic  certification  should  occur  within  the 
organization  where  the  long  distance  call  was  placed  or  accepted 
(in  the  case  of  third  party  and  collect  calls).  The 
organization's  own  official  telephone- rela ted  records  or  those 
prescribed  by  the  certification  program  are  the  basis  for 
certification  of  all  long  distance  calls.  The  organization  TCO 
will  immediately  report  all  unofficial  or  unauthorized  calls  to 
the  supporting  DOIM,  or  his  designated  representative. 

(2)  Unless  otherwise  required  in  the  certification 
program,  the  romn  mine  rnlis-with  the  exception  of  billing  errors 
detected  <3u  r  :  n  j  r,*-r  f  or  man re  cor  t  i  f  i  ca  t  i  on-are  certified  as  they 
occur  at  the  n  r  g n  :  r  a  t  i  o  nn  1  level  .  During  the  preparation  of  the 


SF  1034,  these  calls  will  be  subsequently  and  automatically 
certified  by  the  supporting  DOIM  or  his  designated 
representa  t i ve . 


(3)  The  following  areas  will  be  addressed  by  the  USAISC 
representative  for  the  development  of  BASIC  CERTIFICATION 
procedures.  These  procedures  will  be  documented  in  the  approved 
telecommunications  certification  program  for  the  installation, 
facility,  or  region: 

(a)  Determine  call  detail  reporting  requirements. 

1.  Call  detail  reports  can  include  all  telephone  calls 
or  data  transmissions  placed  through  the  administrative  telephone 
system  of  the  facility.  These  calls  include  local  and  long 
distance  commercial  telephone  calls,  such  as  toll,  message  unit, 
directory  assistance,  Wide  Area  Telecommunications  Service 
(WATS),,  or  other  bulk-service  calls.  Also  included  are  value- 
added  carrier,  Federal  Telecommunications  Service,  AUTOVON, 
forC|^gn  exchange,  and  private  line  calls.  In  general,  any  call 
that  can  be  recorded  on  automatic  message  accounting  (AMA)  or 
station  message  detail  recording  (SMDR)  equipment  is  eligible  for 
call  detail  reporting.  This  reporting  is  the  basis  for  required 
review  and  certification  by  the  customer  organization  placing  or 
accepting  charges  (of  any  type)  for  the  call. 

2.  The  choice  of  calls  to  be  reported  is  based  on  the 
availability  of  SMDR/ ama  equipment  and  reports  processing 
support,  the  likelihood  of  abuse  as  determined  in  paragraph  h  (1) 
(c)  under  SECONDARY  CERTIFICATION,  and  installation/command 
sampling  plans.  The  minimum  allowable  detail  is  a  sample  of  toll 
calls  found  on  commercial  telephone  bills. 


3.  Each  item  of  call  detail  will  include  the  telephone 
number  or  extension  from  which  the  call  was  placed  in  the 
customer's  organization,  the  date  of  the  call,  its  duration,  and 
the  complete  telephone  number,  including  the  area  code  and 
exchange  of  the  number  called.  Where  possible,  as  is  the  case 
with  most  commercial  billings,  the  plain  English  identification 
of  the  city  and  state  of  the  called  number  will  also  be  provided. 
Similar  information  will  be  provided  for  third  party  or  collect 
calls  accepted  by  the  organization. 


4.  Within  type  of  calling,  the  selection  of  call  detail 
items  can  be  grouped  between  routine  and  high  potential  abuse 
type  calls  as  determined  under  SECONDARY  CERTIFICATION.  Routine 
calls  can  be  sampled  I  AW  the  i ns t a  1 1  a t i on/comma nd  sampling  plan 
while  high  potential  calls  will  normally  be  reviewed  and 
certified  on  a  1BBY  basis. 


5  . 


re per  tine  will 


Call  detail 


also  be  used  to  report 


call  information  from  telephone  toll  tickets  (DD  Form  1194)  or 
similar  records  prepared  by  installation  or  facility  PDX 
operators.  Reports  will  be  provided  to  customer  organizations  of 
selected  overseas  AUTOVON  calls,  offnet  AUTOVON  calls,  and 
commercial  toll  calls  not  already  reported  above.  Toll  tickets 
may  occasionally  be  used  to  record  unofficial  (class  B) 
commercial  calls,  unauthorized  AUTOVON  calls,  or  other  operator 
connected  calls  for  which  charges  are  calculated.  In  these 
cases,  toll  tickets  will  be  the  basis  for  FAO  billing  and 
collection  for  the  sale  of  unofficial  communications  services. 

(b)  Distribute  call  detail. 

1.  Call  detail  reports  are  to  be  distributed  in  a 
prompt  manner  so  that  customer  organizations  have  sufficient  time 
to  review  and  certify  selected  call  detail  items. 

2.  The  minimum  required  time  period  is  5  working  days 
for  commercial  telephone  calls.  This  period  normally  ends  with 
the  release  of  the  SF  1034,  Public  Voucher  for  Purchases  or 
Services  Other  Than  Personal.  This  voucher  is  for  payment  of  an 
accompanying  telephone  bill.  Part  or  all  of  the  call  detail 
being  reviewed  by  the  customer  must  correspond  to  the  telephone 
calling  on  such  bills. 

3.  The  USAISC  office  may  make  telephonic  or  electronic 
inquiries  within  the  customer  organization.  These  inquiries  are 
to  check  the  validity  of  sampled  cal  Is- "Were  the  following  calls 
made  for  official  purposes  on  the  date  of...?"  Inquiries  will  be 
directed  to  Telecommunications  Control  Offices  detail  reports. 
Where  the  USAISC  officer  deems  appropriate,  this  procedure  is 
used  to  speed  the  certification  process  and  thereby  avoid  the 
payment  of  interest  penalties  under  the  Prompt  Payment  Act. 

4.  With  assured  distribution  of  call  detail  reports, 
standing  suspenses  may  be  used  to  routinely  report  unofficial 
calls  made  during  certain  billing  periods.  Within  customer 
organizations,  the  efficiency  of  standing  suspense  systems  to 
report  all  unofficial  calls  on  a  timely  basis  will  be  verified 
periodically  under  SECONDARY  CERTIFICATION  procedures. 

(c)  Review  and  certification. 

1.  Review  and  certification  at  the  customer 
organization  is  based  on  .continuous-  internal  control  procedures. 
The  purpose  of  these  procedures  is  to  encourage  the  economical 
and  efficient  use  of  the  administrative  telephone  system  and  to 
limit  its  use  to  offical  calling  by  employees  within  the  customer 
organization.  Procedures  are  described  in  terms  of 
responsibilities  and  duties  for  employees  and  TCOs  within  that 
organ ization  . 
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2.  Internal  control  procedures  ore  based  on  locally- 
developed  guidance,  including  customer  organization  input  from 
the  Telecommunications  Control  Board,  and  are  established  in  the 
approved  telecommunications  certification  program. 

3.  Specific  controls  sould  be  based  on  existing 
administrative  processes  within  the  organization  and  may  include 
written  or  electronically  maintained  telephone  logs,  contact 
reports,  DA  Forms  360,  DA  Forms  1194,  or  other  acceptable 
records.  Where  feasible,  controls  will  be  transparent  to  the 
user  and  automatic.  These  types  of  controls  include  the  use  of 
personnel  access  codes,  individualized  call  detail  reports,  and 
least  cost  routing.  The  information  collected  for  subsequent 
validation  against  call  detail  report  should  approximate  that 
found  on  the  detail  reports  as  descirbed  in  paragraph  (3) (a)3 

a  d  o  v  e  . 

4.  The  SF  1034  is  released  by  the  USAISC  office  on  the 
basis  of  internal  control  procedures  practiced  by  customer 
organizations.  Written  cr  electronic  records  within  the  customer 
organization  and  the  validations  made  against  them  will  be  made 
available  at  the  request  of  USAISC  representatives  for  periodic 
verification. 

(d)  Call  investigation.  The  review  and  certification 
performed  by  customer  organizations  as  a  result  of  call  detail 
reports  and  the  organizations  own  internal  controls  may  identify 
three  types  of  calls: 

--Calls  certified  as  being  made  or  accepted  for  official 
purposes; 

--Calls  declared  unofficial  with  the  caller  identified 

for  subsequent  billing  or  with  the  organizations 

accepting  responsibility  for  the  call;  and/or 

--Calls  that  are  uncertified. 

Call  investigation  will  occur  for  unofficial  and  uncertified 
calls.  The  investigations  will  determine  who  is  responsible  for 
payment  of  the  call,  administrative  charges  as  addressed  below, 
and  may  form  the  basis  for  subsequent  disciplinary  action. 

1.  Unofficial  calls  may  represent  an  erroneous  or 
abusive  use  of  the  administrative  telephone  system.  The 
assessment  of  the  administrative  charge  for  unofficial/ 
unauthorized  toll  calls  will  be  IAW  the  approved 
telecommunications  certification  program  to  include  local 
procedural  changes  made  as  a  result  of  union  negotiations. 

2.  Uncertified  calls  require  additional  information 
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before  they  can  be  determined  official  or  unofficial.  After 
sufficient  internal  investigation,  calls  that  remain  uncertified, 
will  be  referred  to  the  servicing  telephone  company  or 
communications  contractor.  A  record  will  be  made  of  all  calls 
that  remain  uncertified  and  their  disposition.  Such  dispositions 
include:  Acceptance  by  the  contractor  as  a  billing  error, 

acceptance  by  the  government  for  payment,  or  acceptance  by  an 
organization  for  individual  investigation  and  subsequent  action. 
Customer  organizations  having  excessively  high  numbers  of 
uncertified  calls  will  be  subject  to  REMEDIAL  CERTIFICATION 
procedures  as  described  in  paragraph  i  below.  Other  measures  may 
be  used  to  curb  abuse  or  ensure  positive  internal  control.  These 
include  restrictions  on  long  distance  calling,  the  use  of 
telephone  control  numbers,  operator  interventions  for  designated 
extensions,  DA  Forms  360  enforcement  for  all  types  of  calling, 
and  other  measures  described  in  the  approved  telecommunications 
certification  program. 

g.  PERFORMANCE  CERTIFICATION.  Performance 
certification  is  the  systematic  verification  of  bill-related 
charges  for  authorized  telecommmunications  services  performed  by 
a  contractor  to  include  changes  in  service  or  equipment.  It  is 
required  to  avoid  overpayment  by  the  government  and  to  verify  a 
commercial  communications  bill  as  being  correct  and  payable. 

(1)  Performance  certification  is  based  on  a  manual  or 
automated  inventory  of  telecommunications  resources,  adjustments 
to  the  inventory  as  a  result  of  documents  authorizing  change, 
completion  reports,  and  billing  review  and  verification.  The 
beginning  inventory  is  the  result  of  the  annual  revalidation  of 
telecommunications  resource  required  in  AR  105-10.  Change 
documents  include  the  Communication  Service  Authorization  (CSA), 
DD  Form  428,  the  Commercial  Communications  Work  Order  (CCWO) ,  DD 
Form  1367,  and/or  other  locally  required  documents.  Completion 
reports  include  those  provided  by  the  contractor  or  telephone 
company  and  those  required  as  a  part  of  the  certification 
program. 

(2)  The  major  elements  of  performance  certification 

are  : 

(a)  Review  changes  to  the  telecommunications  inventory. 
The  bill  is  reviewed  for  local  service  and  equipment  charges  and 
iscompared  to  the  CSA  (DA  Form  428)  or  other  prescribed 
documentation  to  ensure  that  they  are  correct  with  respect  to: 

1.  Recurring  charges  on  trunks,  tie  lines,  switchboard 
room,  and  terminal  room  equipment. 

2.  Charges  on  PBX  stations  and  extensions, 
miscellaneous  equipment,  and  any  other  equipment  authorized  on  a 
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maximum  limit  basis. 


3.  Charges  for  installation,  deinstallation  or 
ma i n tenance- re  la  ted  authorized  changes. 

(b)  Review  Message  Unit  Charges. 

1.  A  continuing  month-by-month  record  will  be 
maintained  on  message  unit  charges  in  order  that  the  trend  may  be 
monitored.  Sharp  increases/decreases  (as  defined  in  the 
certification  program)  of  the  member  of  message  units  used  will 
be  investigated  with  the  telephone  company  and  corrective  action 
taken . 

2.  Additional  local  message  unit  charges  will  show  the 
number  and  cost  of  additional  message  units  used  beyond  the 
allowance  included  in  the  monthly  charge  of  trunks.  The  total 
cost  of  message  units  for  interzone  messages  normally  will  be 
billed  separately  and  appropriately  designated;  however,  separate 
listings  of  each  message  unit  call  is  permissible  as  may  be 
arranged  with  the  telephone  company. 

(c)  Review  Telephone  Toll  Service  Charges. 

1.  Supporting  evidence  for  toll  charges  may  be 
presented  by  the  telephone  company  in  three  ways  : 

--By  the  telephone  company  toll  ticket  or  mark 
sense  card  originals. 

--By  a  commercial  statement  listing  in 
chronological  order  the  toll  calls  charged  to  the  PBX  nurnuer. 

--By  a  listing  of  the  toll  calls  charged  to 
individual  PBX  extensions  or  code  numbers  assigned  thereto. 

2.  Select  at  random  approximately  10  percent,  bat  not 
less  than  25  in  number,  of  the  billed  calls.  Check  the  accuracy 
of  the  billed  computations  by  totaling  the  charges  listen  on  the 
telephone  company  toll  statements,  and  compare  tne  toll  tickets 
or  other  prescribed  documentation  on  toll  calls  witn  the.-  till. 

On  any  point  that  disagrees,  the  telephone  company  will  re 
requested  to  check  the  call. 

3.  If  the  number  of  discrepancies  between  the  selectee 
billed  calls  and  the  corresponding  toil  tickets  cr  other 
documentation  exceeds  a  target  percentage  (designated  in 
certification  program)  of  the  total  number  of  billed  ,te~s 
selected  for  spot  check,  all  billed  calls  will  ce 

Otherwise,  periodic  basis  by  the  supporting  C  -b  : 

designated  representative. 
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(1)  The  purposes  of  secondary  certification  are: 


--To  verify  telecommunication  internal  control 
procedures  for  support  organizations. 

--To  provide  reports  to  support  the  accurracy  of 
both  basic  and  performance  certification. 

(2)  Each  organization  will  be  reviewed  at  least 
quarterly  for  secondary  certification.  The  review  consists  of 
one  or  more  of  four  optional  procedures.  In  the  case  of 
fraudulent  or  excessive  abuse,  discovered  as  a  result  of  these 
procedures,  remedial  certification  described  below  will  be 
instituted  by  the  supporting  C-E  officer. 

(3)  The  guidelines  for  at  least  four  optional 
procedures  are  provided  below.  The  particular  procedure  to  be 
used  for  an  organization  will  depend  on  past  performance, 
available  resources,  degree  of  automated  support,  and  class  of 
certification  (discussed  in  paragraph  f) .  Procedures  may  be  used 
alone  or  interactively.  Minimally,  secondary  certification 
procedures  will  include: 

(a)  Onsite  Review.  The' organization ' s  official  SOPs , 
telephone  call-related  records,  or  other  documentation  required 
by  the  certification  program  will  be  analyzed  with  corresponding 
telephone  bills. 

(b)  Telecommunications  Resource  Review.  The  max  limit- 
CSA  and  the  organization's  basis  of  issue,  or  other  authorization 
documents  as  required,  will  be  compared  with  actual  equipment  and 
service.  This  review  can  be  used  to  partially  satisfy  the  annual 
review  and  revalidation  required  in  AR  105-10. 

(c)  Review  of  Usage  Indicators. 

1.  These  indicators  allow  f.  month-by-month  comparison 
of  telecommunications  usage,  cost,  g’ade  of  service,  or  other 
criteria.  Indicators  are  established  on  the  basis  of  current  and 
historical  local  data  and  are  documented  in  the  certification 
program.  Local  data  is  gathered  during  performance  and  secondary 
certifications.  Ultimatley,  good  usage  indicators  should  provide 
the  supporting  C-E  officer  or  his  designee  the  ability  to 
segregate  mi s s i on- re  la  ted  increases  in  telecommunications  from 
those  usage  patterns  requiring  communications  economy  and 
discipline. 

2.  Population  served,  1 i nes- i n- ser vi ce  ,  grade  of 
service,  number  of  calls,  cos t- pe r- ca 1 1  ,  cost-per-minute , 

a ve r age- 1  eng t n- of -ca 1 1  ,  co  s  t  -  pe  r  -  b  i  1 1  or  segment  thereof  (per 
line,  per  user  organization,  per  type  service,  etc.)  and  other 
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factors,  depending  upon  their  availability,  can  be  used  as  usage 
indicators  . 

3.  The  method  of  analysis  used  to  review  these 
indicators,  summary  reports  available  as  a  result  of  their  use, 
location  of  reports,  and  the  personnel  responsible  for 
maintaining  them,  should  be  addressed  in  the  certification 
program . 

(d)  High  Potential  Review.  This  procedure  requires  the 
selective  verification  of  commercial  long  distance’  calls  having  a 
high  potential  for  being  fraudulent  or  abusive.  High  potential 
calls  can  include: 

1.  Calls  over  10  minutes  long. 

2.  Calls  repeatedly  made  to  the  same  location  in  the 
same  or  separate  billing  periods. 

3.  Calls  to  unlikely  or  abnormal  locations. 

4.  Collect  and  third  party  calls,  especially  where  the 
organization's  mission  does  not  support  such  calls. 

5.  Calls  made  after  working  hours  and  during  lunch  and 
lightly  populated  flextime  periods. 

a.  Selective  verification  will  result  in  a  special 
report  to  the  organization  making  such  calls.  Special  reports 
can  be  produced  by  automated  call  detail  analysis  or  manually. 

b.  A  log  will  be  maintained  of  who  received  the  report, 
the  date  provided,  and  follow-up  actions  taken. 

i.  REMEDIAL  CERTIFICATION.  This  process  is  required  when 
abuse  is  judged  excessive  or  potentially  high  on  an  organization- 
by-organization  basis.  As  necessary,  it  can  be  applied  to  the 
entire  installation  or  activity.  Remedial  certification  can  also 
be  instituted  where  basic  certification  is  not  performed  IAW  the 
locally  required  certification  program. 

(1)  Remedial  certification  can  include  DA  Form  360 
item-by-item  examinations,  the  use  of  continuous  secondary 
certification  procedures,  frequent  onsite  inspections,  and  other 
actions  as  documented  in  the  certification  program. 

(2)  Remedial  certification  will  remain  in  effect  until 
adequate  basic  certification  is  reestablished  by  the  organization 
where  abuse  was  considered  excessive. 

j.  DOCUMENTATION  AND  REPORTING  REQUIREMENTS.  The 
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installation,  activity,  or  MACOM-lcve 1  certification  program 
should  be  documented  in  accordance  with  the  standard  format 
described  below.  Additionally,  an  annual  summary  of  the 
certification  program  is  required  in  the  Telecommunications 
Economy  And  Discipline  Report  (RCS  CC-54  )  in  AR  1U5-113. 

(1)  Documentation  Requirements.  The  certification 
program  should  be  clearly  and  consistently  documented.  The 
procedures  used  to  implement  its  policy  requirements  must  be 
detailed  and  understandable.  Any  SOPs  developed  for  the  program 
should -be  attached.  Where  SOPs  must  be  developed  by 
participating  organizations  samp'le  guidelines  are  recommended. 
The  format  below  outlines  minimum  subject  areas  to  be  documented 
in  the  program: 


SUBJECT 


CONTENT 


Policy 


The  management  position  regarding 
certification  of  long  distance 
calls  by  supported  organizations 


Scope 


Responsibilities 


Who  is  required  to  follow  the 
program  of  the  organizations 
present  at  the  installation, 
activity,  or  on  a  MACOM-wide  basis, 
where  appropriate. 

Identify  who  is  responsible  for 
approval,  execution,  and  review  of 
the  certification  program. 


Constr a i nts 


Limitations  regarding  the 
administration  or  execution  of  the 
program . 


Overview 


Class  of  Cer t i f i ca t i on 


Procedures 


Describe  how  the  program  is 
intended  to  work  generally. 

Indicate  class  of  certification  IAW 
this  regulation.  Where  required, 
allow  space  to  cross-reference  the 
document  granting  program  approval. 

Detail  the  procedures  for  each 
level  of  certification  as  outlined 
be  1 ow . 


Describe  procedures.  If 
organizations  must  develop  SOPs 
indicate  format,  and  where  possible 
a  sample  SOP. 


Basic  Certification 


State  who  in  the  supported 
organization  is  responsible  for  the 
control  and  identification  of 
telephone  control  officers.  If  the 
supporting  DOIM  is  responsible  for 
these  actions,  describe  internal 
control  procedures. 

Where  necessary  indicate 
specialized  certification 
requirements  levied  on  particular 
organizations.  For  example,  the 
responsibility  for  otherwise 
unidentified  collect  calls  accepted 
at  phones  within  their  operational 
control  may  be  described  here. 

Performance  Certification  Describe  inventory,  service 

ordering  and  completion,  and  bill 
verification  internal  control 
procedures.  Describe  sampling 
method  and  target  percentages  where 
applicable. 

Secondary  Certification  Describe  specific  procedures  for 

each  of  the  review  options  in 
paragraph  h.  Include  additional 
options  specifically  developed  for 
the  program. 

Remedial  Certification  Describe  procedures  required, 

basis  for  their  being  required,  and 
follow-up  actions  required  for 
their  removal . 

k.  APPROVAL  OF  THE  CERTIFICATION  PROGRAM.  The  certification 
program  is  approved  at  two  levels  depending  on  its 
classification.  The  first  level  is  local,  where  required 
approval  is  by  the  installation  or  activity  commander.  The 
second  level  is  for  reyulatory  compliance  and  depends  on  the 
class i f ica t i on  of  subscriber  access  to  commercial  dialing  and 
long  distance  calling  generally.  Each  class  is  related  to  the 
degree  of  unrestricted  access  availaole  to  the  general 
subscriber,  and  consequently  the  potential  for  telephone  abuse 
and  unofficial/unauthorized  use.  These  classes  are: 

CLASS  APPROVAL  DESCRIPTION 


Total  ope r a  to r - r es t r  1  c ted  access 
to  long  distance  calling  for  all 
subset iscis. 


I 


Support i ng 
C-E  Officer 


Majoc  Subordinate 
Command  (USAISC) 


Major  Subordinate 
Command  (USAISC) 


HQ  USAISC 


Mach i ne- res t r i c ted  access  to  long 
distance  calling.  Includes  least 
cost  routing  supplied  access  to 
ODD,  WATS,  and  FTS . 

Unrestricted  access  to  long 
distance  calling.  The 
certification  program  is  applicable 
to  monthly  commercial 
communications  bills  of  less  than 
$100 , 000 . 

Unrestricted  access  to  long 
distance  calling.  The 
certification  program  is  applicable 
to  monthly  commercial 
communications  bills  of  more  than 
$100 , 000 . 


APPENDIX  B 


CERTIFICATION  OF  COMMERCIAL  LONG-DISTANCE  TELEPHONE  CALLS  BY  SAMPLING 


1.  INTRODUCTION.  Public  Law  88-521  authorizes  sampling  methods  to  facilitate 
the  certification  of  vouchers  provided  that  the  sampling  procedures  are  in 
conformance  with  GAO  Policy  and  Procedures  Manual,  title  3,  chapter  10.  Cost 
savings  and  other  benefits  accrue  when  sampling  operations  are  adopted  provided 
that  there  is  a  significant  quantity  to  be  reviewed  and  sufficient  management 
control  exists  to  justify  the  risks  associated  with  sampling  operations.  But 
to  institute  and  continue  the  sampling  program,  it  is  necessary  to  issue 
instructions,  indoctrinate  personnel,  and  document  results  and  follow-up 
action. 


2.  SAMPLING  OPERATIONS.  The  sequence  of  steps  used  when  applying  acceptance 
sampling  techniques  is  as  follows: 

a.  Establish  the  population  that  will  be  sampled  and  will  be  certified  if 
the  sample  meets  the  acceptance  criteria  of  the  sampling  plan. 

1>.  Select  the  required  number  of  toll  call  samples  from  the  population 
such  that  they  are  unbiased  representatives  of  the  population. 

c.  Review  each  sampled  toll  call  to  determine  if  it  is  official  or  not  IVJA 
the  definitions  used  and  locally  established  certification  procedures. 

d.  Compare  the  results  obtained  in  the  audit  of  the  sampled  toll  calls 
with  the  acceptance  criteria  of  the  sampling  plan  and  take  the  appropriate 
action.  If  the  criteria  is  met,  certify  the  remaining  population  of  toll 
calls,  but  perform  necessary  follow-up  of  any  problem  toll  calls  found  in  the 
sample.  If  the  criteria  is  not  met,  refer  the  toll  call  population  that  fails 
the  sampling  acceptance  criteria  to  the  individual  responsible  for  certifying 
the  calls,  for  guidance.  The  next  action  can  range  from  100Z  screening  of  the 
remaining  toll  calls  to  follow-up  of  only  those  areas  where  problems  were 
detected.  In  any  case,  follow-up  is  required  for  all  observed  problems  to 
initiate  corrective  action. 

e.  Establish  the  acceptance  criteria  for  the  next  month's  telephone  bill 
as  illustrated  in  appendix  C. 


3.  SAMPLING  PLANS.  DOD  recommends  the  attributes  sampling  plans  and 
procedures  of  MIL-STD-105D,  but  other  types  and  variations  may  be  used  with 
proper  approval.  Attribute  plans  are  those  in  which  a  sampled  item  is  either 
good  or  bad,  e.g.  the  toll  call  is  either  official  or  it  is  not. 

a.  The  protection  afforded  by  a  sampling  plan  is  specified  by  the 
Acceptance  Quality  Level  (AQL).  For  example,  if  it  is  allowable  that  up  to 
about  7  percent  of  the  toll  call  listing  can  be  unofficial,  then  the  sampling 
plan  with  an  AQL  of  2.5Z  should  be  used.  This  recommendation  is  made  by 
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interpreting  the  Operating  Characteristic  (OC)  curve  for  the  2.5Z  AQL  sampling 
plans.  The  1.5Z  AQL  sampling  plans  allow  about  4  percent  of  the  tolls  call  to 
remain  in  populations  accepted  by  sampling;  the  AQL  of  4.0Z  allows  about  9 
percent . 


b.  Three  levels  of  sampling  plans  are  available  in  MIL-STD-105D: 

Tightened,  Normal,  and  Reduced.  The  Normal  Level  is  used  when  sampling  methods 
are  introduced.  After  a  succession  of  "accept"  decisions  are  made  at  this 
Level,  greater  risks  can  be  taken,  and  the  sampling  program  moves  to  the 
Reduced  Level.  If  a  "reject"  decision  is  made,  the  next  month's  toll  calls  are 
subject  to  the  Tightened  Level.  Then,  after  a  succession  of  "accept"  decisions 
are  made  at  this  Level,  the  sampling  program  returns  to  the  Normal  Level. 

c.  MIL-STD-105D  attribute  single  sampling  plans  for  AQLs  of  1.5Z,  2.5Z, 
and  4.0Z  are  shown  below  as  they  apply  to  population  sizes  of  151  to  3200, 
where  n  *  sample  size,  AC  =  acceptance  number,  RE  *  rejection  number. 


Number 
of  Toll 

Calls  in 

Sampling 

Level 

n 

Acceptance  Quality  Level 
1.5Z  2.5Z 

AC  RE  n  AC  RE  n 

(AQL) 

4.0Z 

AC 

RE 

Population 

Reduced* 

3 

0 

1 

8 

0 

2 

5 

0 

2 

151-280 

Normal 

32 

1 

2 

32 

2 

3 

32 

3 

4 

Tightened 

50 

1 

2 

50 

2 

3 

50 

3 

4 

Reduced* 

13 

0 

2 

8 

0 

2 

8 

1 

3 

281-500 

Normal 

50 

2 

3 

50 

3 

4 

50 

5 

6 

Tightened 

80 

2 

3 

80 

3 

4 

80 

5 

6 

Reduced* 

13 

0 

2 

13 

1 

3 

13 

1 

4 

501-1200 

Normal 

80 

3 

4 

80 

5 

6 

80 

7 

8 

Tightened 

125 

3 

4 

125 

5 

6 

125 

8 

9 

Reduced* 

20 

1 

3 

20 

1 

4 

20 

2 

5' 

1201-3200 

Normal 

125 

5 

6 

125 

7 

8 

125 

10 

11 

Tightened 

200 

5 

6 

200 

8 

9 

200 

12 

13 

*If  the  AC  is  exceeded,  but  the  RE  has  not  been  reached,  accept  the  toll  call 
population,  but  reinstate  Normal  Level  sampling  plan  on  the  next  month's 
population. 

d.  General  sampling  procedure.  Reference  the  sampling  table  excerpt  in 
paragraph  3.c.  and  the  illustrative  example  given  in  appendix  C. 

(1)  Randomly  select  a  representative  sample  of  size  "n"  from  the 
population.  (If  the  toll  call  listing  to  be  sampled  contains  about  850  entries 
and  the  Normal  Level  applies,  select  a  sample  of  80  entries.) 

(2)  If  the  number  of  questionable  calls  in  the  sample  of  "n"  does  not 
exceed  the  quantity  "AC",  certify  the  population.  If  the  number  of 
questionable  calls  in  the  sample  equals  or  exceeds  the  quantity  of  "RE",  hold 
the  population  for  disposition  because  the  population  cannot  be  certified  on  a 
sampling  basis.  (If  in  the  example,  a  total  of  5  questionable  calls  is 
detected,  population  acceptance  depends  upon  the  standard  for  acceptance  as 
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given  by  the  AQL:  For  an  AQL  of  2.5 X  or  4.0Z,  the  population  would  be 
certified  on  a  sampling  basis;  but  for  an  AQL  of  1.5%,  the  population  could  not 
be  certified  on  a  sampling  basis.) 

(3)  Next  month's  certification  process  depends  upon  the  results 
obtained  in  the  current  month's  sampling  ''accept''  or  "reject”  decision.  If  an 
accept  decision  is  reached,  the  following  month  can  be  sampled  at  the  same 
level  as  before,  or,  if  this  is  the  last  of  "k"  successive  accept  decisions, 
the  following  month  may  be  sampled  at  a  less  stringent  level  of  sampling,  where 
the  value  "k"  is  defined  in  the  sampling  plan  as  the  criteria  for  admission  to 
that  level.  If  a  reject  decision  is  reached,  the  following  month  must  be 
sampled  at  a  the  Tightened  Level.  (Also  note  that  it  is  possible  to  change  to 
a  Normal  Level  from  the  Reduced  Level  if  the  reject  decision  is  not  reached  but 
only  a  provisional  acceptance  decision  is  possible,  as  noted  in  the  sampling 
table . ) 

(4)  Investigate  all  questionable  toll  calls.  The  fact  that  a  toll 
call  is  later  found  to  be  definitely  official  in  nature  does  not  change  the 
acceptance  criteria  decision  of  the  sampling  plan.  If  the  individual 
responsible  for  an  unofficial  call  can  be  identified,  appropriate  follow-up 
action  should  be  taken  and  documented  to  prevent  recurrence,  so  that  sampling 
operations  can  have  a  better  chance  of  continuing. 

(5)  The  cost  of  a  call  may  be  introduced  into  the  criteria  for 
acceptance  to  limit  the  undetected  unofficial  call  charges  in  the  bills  that 
are  certified  by  sampling  methods.  Define  a  given  dollar  amount  as  a  major 
unofficial  call.  Combine  the  dollar  values  of  all  of  the  unofficial  calls 
found  in  the  sample  to  establish  an  equivalent  number  of  major  unofficial 
calls.  Then  compare  the  number  of  major  unofficial  calls  to  the  sampling  plan 
acceptance  criteria.  For  example,  if  the  standard  of  $5.00  per  toll  call 
defines  a  major  unofficial  call,  and  the  total  of  the  toll  call  charges  on  8 
calls  is  $53.21,  then  a  total  of  10  major  unofficial  calls  is  formed  to  be 
compared  with  the  sampling  plan  accept  mce  criteria;  if  the  charges  are 
$19.25,  then  there  is  a  total  of  only  3  major  unofficial  calls. 


4.  RECOMMENDED  SAMPLING  PLAN  PARAMETERS: 

a.  MIL-STD-105D  single  sampling  plan  with  AQL  of  2.5Z. 

b.  Successive  "accept"  decisions  to  proceed  from  the  Tightened  Level  to 

the  Normal  Level,  and  from  the  Normal  Level  to  the  Reduced  Level:  6  (which 
corresponds  to  6  months). 

c.  Population  definition:  The  toll  calls  with  from  10  to  30  minutes 
duration. 

d.  Acceptance  criteria:  Determine  if  the  population  can  be  certified  on  a 

sampling  basis  by  using  equivalent  major  unofficial  calls  to  compare  with  the 
sampling  plan  accept  or  reject  values.  Define  a  major  unofficial  call  as  an 
equivalent  call  with  a  charge  of  $10.00.  This  value  should  reflect  the  average 
charge  experienced  for  a  toll  call  of  20  minutes,  the  median  of  the  range  of  10 

to  30  minutes  duration.  If  $10.00  does  not  meet  this  condition,  it  should  be 

corrected  to  reflect  the  historical  information  of  the  installation. 


APPENDIX  C 


EXAMPLE  OF  A  CONTROL  CHART  FOR  MONITORING  TOLL  CALL  SAMPLING  RESULTS 
MIL-STD-105D  Single  Sampling  with  AX  of  2.5% 


Percentage  of 
Unofficial 
Toll  Calls  in 
Sample  Checked 

6-Month 

Baseline  1.3% 


,a  Upper  Cbntrol  Limit  O 


0 

J 

F 

M 

A 

M 

J 

u— 

J 

A 

S 

O 

N 

Sampling  Level* : 

II 

n 

III 

III 

ni 

MONTH 

III  III 

III 

III 

III 

II 

Population  Size: 

1002 

1251 

1496 

2240 

784 

1104 

952 

882 

1059 

1465 

1326 

Control  Limit  (UCL) : 

5.1 

4.3 

3.7 

3.7 

4.3 

4.3 

4.3 

4.3 

4.3 

3.7 

4.3 

Sample  Size  (n) : 

80 

125 

200 

200 

125 

125 

125 

125 

125 

200 

125 

Acceptance  No.  (AC) : 

5 

7 

8 

8 

5 

5 

5 

5 

5 

8 

7 

Unofficial  Calls  (d): 

2 

8 

8 

10 

5 

3 

0 

1 

2 

6 

6 

Accept  (A)/Ifeject  (R): 

A 

R 

A 

R 

A 

A 

A 

A 

A 

A 

-A 

%  Unofficial  (d/n): 

2.5 

6.4 

4.0 

5.0 

4.0 

2.4 

0.0 

0.6 

1.6 

3.0 

4.8 

Notes  ( See  below) : 

1 

2 

3 

4 

5 

6 

7 

*  Levels:  I 
Notes:  1. 

2. 


3. 


4. 


5. 

6. 


7. 


=  Reduced;  II  =  Normal;  III  =  Tightened. 

Start  sampling  program  at  the  Normal  Level. 

Population  size  requires  larger  sample  size.  Unofficial  calls 
found  in  the  sample  exceed  the  acceptance  number,  population 
cannot  be  accepted  on  a  sampling  basis.  Following  month  requires 
sampling  at  the  Tightened  Level. 

Sample  size  and  acceptance  nunber  are  established  by  the  Tightened 
level.  UCL  exceeded  again  to  indicate  need  for  continued 
corrective  action;  there  is  a  significant  differenoe  from  the 
baseline  fraction  defective  established  for  the  installation. 
Unofficial  calls  found  in  sample  exceed  acceptance  number  again. 
Continue  the  Tightened  Level  next  month  and  until  6  successive 
months  are  accepted  on  a  sampling  basis. 

Population  size  requires  smaller  sample  size. 

Population  size  requires  larger  sample  size.  Next  month  the 
sampling  can  return  to  the  Normal  Level  because  this  is  the  6th 
successive  month  that  sampling  methods  accepted  the  population. 
Population  is  certified  on  a  sampling  basis,  but  the  upper  limit 
was  exceeded  to  signal  significant  difference  from  the  standard 
established  for  the  installation. 
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Ccmputation  of  the  historical  percentage  in  the  example : 

Ttotal  toll  calls  in  previous  6  months:  6731 

Total  unofficial  toll  calls  detected:  89 

p'  =  89/6731  =  0.013  (or  1.3%) 

Computation  of  the  upper  control  limit  (UCL)  for  the  example: 
UCL  =  p’  +  3  VlpHTT  -  p')/n' 

«  0.013  +  31/(0.013)  (1  -  0.013)/n1 
=  0.013  +  (0. 33982 )/(  YrT) 

=  0.013  +  (0.33982) (0.11180)  =  5.1%,  for  n  =  80 

=  0.013  +  (0.33982) (0.08944)  =  4.3%,  for  n  =  125 

*  0.013  +  (0.33982) (0.07071)  =  3.7%,  for  n  =  200 
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Toll  Call  Certification  by  Statistical  Samp! ing  Methods 


1-  INTRODUCTION.  AR  105-23  establishes  that  toll  calls  must  be  certified  th«t 
they  are  in  the  interest  of  the  government,  prior  to  the  payment  of  the  monthly 
toll  call  bill.  Public  Law  88-521  authorizes  sampling  methods  to  facilitate 
this  certification  process,  provided  that  the  sampling  procedures  are  tn 
conformance  with  GAO  Policy  and  Procedures  Manual,  title  3,  chapter  10.  A 
survey  of  toll  call  certification  practices  and  experience  at  typical  Army 
install ations/acti vi ties  was  made  to  examine  the  practicality  of  the  sampling 
approach.  It  is  evident  that  some  install ati ons/acti vi ti es  exercise  sufficient 
management  control  to  justify  the  risks  associated  with  sampling  operations. 
Cost  savings  and  other  benefits  accrue  when  sampling  operations  are  adopted, 
but  along  with  these  advantages  come  the  requirements  for  special  instructions, 
indoctrination,  and  supporting  documentation. 

2.  CURRENT  CERTIFICATION  OPERATIONS. 


a.  Sources: 

(1)  With  the  cooperation  of  the  7th  Signal  Command,  detailed  information 
on  the  toll  call  certification  workload,  costs,  usage  abuse,  and  procedures  was 
requested  from  10  Army  installations  and  from  the  recruiting  command.  These 
Army  installations  were  selected  because  they  appear  to  be  a  cross  section  of 
toll  call  activity  based  upon  1983  toll  call  costs  throughout  CONUS.  Data  was 
readily  available  at  six  sites,  as  reflected  in  their  prompt  and  complete 
response.  Table  2-1  represents  the  information  provided.  Bayonne  was  unable 
to  provide  requested  information  because  an  on-site  Call  Detail  Recording  (CDR) 
system  was  being  installed  and  cutover  in  the  period  of  time  indicated.  The 
Presidio  at  San  Francisco  phoned  that  the  data  requested  was  not  readily 
available  from  their  monthly  bill  which  had  some  4,000  pages;  they  w2*-e  excused 
from  participation.  Fort  Lewis  and  St.  Louis  DMATS  made  no  response.  A  trip 
was  made  to  Fort  Sheridan  at  their  invitation  to  gain  insight  into  the  special 
problems  and  conditions  that  characterize  the  certification  operations  within 
the  recruiting  command.  The  analysis  of  the  data  obtained  provides  a  basis  for 
understanding  how  sampling  methods  might  impact  Army  toll  call  certification 
operati  ons . 

(2)  Data  provided  from  Fort  Ritchie,  relating  to  the  administrative 
charges  for  unoffici al /unauthori zed  telephone  toll  calls,  was  used  also  in  this 
study.  The  report  includes  the  number  of  toll  calls  and  unofficial/ 
unauthorized  toll  calls  during  1983  from  Tobyhanna,  Hawthorne,  Rock  Island,  and 
Fort  Ritchie,  as  listed  in  table  2-1. 

(3)  RETAM  data  includes  toll  call  costs  throughout  CONUS  Army 
installations  during  1983.  This  cost  information  is  plotted  in  a  frequency 
histogram,  figure  2-1,  for  85  installations.  The  1983  costs  for  the  10 
locations  listed  do  span  the  full  range  of  installation  toll  call  costs. 
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(4)  The  recruiting  command  encompasses  an  organization  of  5  brigades  with 
56  battalions,  259  companies,  and  1,500  full-time  and  part-time  stations  where 
almost  all  of  the  communications  outside  of  the  immediate  geographical  area  a*e 
toll  calls.  The  structure  of  this  conwand  is  shown  in  figure  2-2.  The  toll 
call  cost  information  for  the  year  ending  30  Sep  84  is  plotted  in  a  frequency 
histogram,  figure  2-3,  for  55  battalions.  The  number  of  toll  calls  represented 
by  these  costs  was  estimated.  Unofficial  toll  call  occurrence  was  largely 
unknown,  except  for  the  findings  documented  in  audit  reports. 

b.  Workload. 

(1)  Sampling  methods  can  provide  economies  and  other  benefits  where  there 
is  a  significant  workload.  The  toll  calls  listed  in  the  monthly  telephone 
bill,  less  those  that  are  excluded  by  administrative  procedure,  define  the  toll 
call  certification  workload. 

(2)  Figure  2-4  presents  an  estimate  of  the  percent  of  the  Army 
installations  having  various  levels  of  certification  workload.  For  example,  20 
percent  of  the  installations  have  less  than  500  toll  calls  per  month  to 
certify;  29  percent  have  more  than  10,000  per  month  to  certify;  or  if  1,500  or 
more  calls,  per  month  signals  the  need  for  possible  certification  by  sampling 
methods,  then  about  60  percent  of  the  Army  installations  are  candidates.  The 
curve  shown  in  figure  2-4  was  derived  from  the  regression  curve  fitted  to  the 
frequency  histogram  of  figure  2-1  with  $2  per  toll  call  as  the  conversion 
factor.  Note  that  table  2-1  computed  the  average  cost  per  toll  call  to  be 
S2.08. 

(3)  The  toll  call  certification  workload  within  the  recruiting  command 
depends  upon  how  the  brigades  establish  this  responsibil ity.  If  certif ication 
is  performed  at  the  station  level,  the  number  will,  of  course,  be  small.  It 
could  be  accomplished  by  the  geographical  area  covered  by  one  or  more  telephone 
companies,  by  the  company  level  personnel,  or  battalion  level  communications- 
electronics  ( C-E )  officer,  or  even  at  the  brigade  level.  This  conmand  does  not 
require  that  all  toll  calls  be  certified.  Each  recruiting  station  has  a 
listing  of  telephone  prefixes  for  which  no  record  is  required.  Calls  within 
the  chain-of -command  and  some  internal  business  calls,  such  as  calls  concerning 
entrance  examinations,  are  not  subject  to  certification.  In  fact,  only  about 
30  percent  of  the  toll  calls  that  are  made  at  the  station  level  require 
certification  by  administrative  procedure.  These  toll  calls  must  be  recorded 
on  DA  Form  360  with  an  explanation  of  their  purpose,  such  as  check  of 
references,  school  records,  medical  history,  birth  certificates,  police 
records,  etc. 

c.  Status. 

(1)  The  application  of  sampling  methods  implies  that  some  percentage  of 
unofficial  toll  calls  is  allowed  to  remain  in  the  telephone  bill  when  it  is 
paid.  When  the  person  responsible  for  toll  call  certification  executes  the 
sampling  procedure  in  good  faith,  he  is  relieved  of  any  liability  for  these 
illegal,  improper,  or  incorrect  payments.  The  role  of  the  sampling  plan  is 
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MONTHLY  TOLL  CALL  CERTIFICATION  WORKLOAD  (000  CALLS) 

*  # 

Figure  2-4 


to  discriminate  between  the  allowable  percentage  and  the  level  where  an 
excessive  percentage  of  unofficial  toll  calls  exist.  AR  105-23,  chapter  5,  * 
applies  a  5  percent  limit  to  certain  audits  which,  if  exceeded,  requires  that 
all  billed  calls  be  checked  for  discrepancies.  If  the  standard  were  to  be 
defined  such  that  no  more  than  5  percent  of  the  toll  calls  be  unofficial,  then 
it  is  apparent  from  table  2-1  that  some  installations  are  not  ready  for 
sampling  methods  even  though  their  workload  is  large  enough,  namely.  Fort 
Belvoir,  White  Sands,  Fort  Ritchie,  and  Fort  Dix,  but  the  unofficial  toll  call 
percentages  at  Fort  Hood  and  Rock  Island  indicate  that  sampling  methods  are 
appropriate.  Tobyhanna  and  Jefferson  PG  have  very  low  percentages  of 
unofficial  toll  calls,  but  their  small  volume  of  calls  eliminates  them  from 
consideration  in  the  application  of  sampling  methods.  The  above  statistics  for 
unofficial  toll  call  occurrence  may  be  misleading  because  other  unofficial 
toll  calls  probably  remain  undetected  or  otherwise  disguised. 

(2)  Followup  to  determine  source  is  required  for  all  toll  calls  that  are 
believed  to  be  unofficial.  For  those  unofficial  calls  where  the  source  is 
identified,  toll  charges  and  an  administative  fee  are  collected,  and 
disciplinary  action  may  be  taken.  The  success  in  assigning  responsibil  ity  for 
unofficial  toll  calls  varies  between  locations  as  is  observed  in  figure  2-5 
White  Sands  with  an  87  percent  success  rate  in  identifying  source  (3,075  out  of 
3,973)  contrasts  with  the  15  percent  rate  at  Fort  Dix  (52  out  of  343). 

Effective  corrective  measures  to  control  telephone  abuse  are  essential  to  the 
startup  and  continuance  of  a  sampling  program. 

(3)  USAISC-USAREC  at  Fort  Sheridan  has  pursued  an  aggressive  audit  and 
training  policy  in  an  attempt  to  control  the  unofficial  use  of  telephone 
facilities.  This  has  involved  inspection  teams  from  the  brigade  level,  IG, 
USAISC-USAREC,  and  the  U.S.  Army  Audit  Agency  { USAAA ) .  Excerpts  from  typical 
audit  reports  are  contained  in  figures  2-6  and  2-7.  The  focus  of  these  audits 
is  to  check  compliance  with  administration  procedures.  This  is  not  quite  the 
same  as  auditing  to  determine  whether  or  not  a  toll  call  was  for  official 
government  business.  When  official  calls  are  made  but’  not  documented,  they  are 
scored  as  unofficial  by  implication.  Conversely,  unofficial  calls  could  be 
documented  to  appear  as  official  calls.  Note  the  comment  on  figure  2-6  for 
West  CO  and  North  CO  wherein  records  were  not  maintained  contemporaneously. 
Figure  2-7  reflects  the  status  of  compliance  to  adminstrative  requirements  at 
several  battalion  level  locations.  Based  upon  the  audit  findings  presented  in 
figures  2-6  and  2-7,  none  of  the  battalion  level  organizations  are  sufficiently 
under  control  to  permit  sampling  methods. 

(4)  The  application  of  sampling  methods  also  depends  upon  evidence  of 
control  on  a  month-to-month  basis.  Table  2-2  provides  month-to-month  data  for 
White  Sands  and  Fort  Hood,  two  locations  that  appear  ready  for  sampling  for 
other  reasons.  Fort  Hood  remains  in  statistical  control  throughout  the  6-month 
period.  This  is  because  unofficial  toll  call  percentages  lie  beneath  the  Upper 
Control  Limit  (UCL);  however,  White  Sands  does  not.  Based  on  this  condition, 
White  Sands  is  ineligible  for  sampling  methods. 

(5)  Table  2-1  presents  the  cost  per  toll  call  averages  for  all  calls  and 
for  unofficial  calls.  By  inspection,  it  is  seen  that  there  are  important 
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differences  between  these  averages.  Unofficial  calls  are  the  high  cost  calls 
at  West  Point,  Fort  Hood,  and  Fort  Dix;  the  low  cost  ones  are  the  suspect  on^fs 
at  Fort  Bel  voir.  This  type  of  data  is  useful  in  guiding  the  certification 
review  even  when  sampling  methods  are  not  appropriate. 

3.  SAMPLING  OPERATIONS. 

a.  Sampling  plans  provide  decisions  that  determine  whether  or  not  the 
population  from  which  the  sample  is  drawn  will  be  certified;  therefore,  it  is 
necessary  to  define  exactly  what  constitutes  the  population.  The  certification 
requirements  of  AR  105-23  focus  only  on  toll  calls  that  are  billed  by  the 
telephone  company,  but  not  all  of  these  calls  are  included  in  the  population  to 
be  sampled.  For  example: 

(1)  If  the  caller  makes  arrangements  with  his  telephone  control  officer 
(TCO)  to  make  an  unofficial  call,  that  information  is  forwarded  to  the 
communications-electronics  (C-E)  officer,  along  with  the  payment  of  the  toll 
call  charges.  These  calls  are  excluded  from  the  population  to  be  sampled. 


(2)  If  the  caller  is  authorized  to  make  toll  calls  on  certain  prefixes 
without  having  to  record  the  information  on  DA  Form  360,  as  is  the  practice  in 
the  recruiting  command,  the  calls  are  excluded  from  the  population. 


(3)  Some  calls  do  not  become  part  of  the  population  because  they  are 
always  checked;  such  as,  overseas  calls  made  through  an  operator,  and  calls 
that  are  specifically  forbidden  but  happen  due  to  extenuating  circumstances  as 
is  the  case  with  some  collect  calls  and  third-party  calls.  Credit  card  calls 
normally  are  not  subject  to  review  because  they  are  assigned  to  a  responsible 
individual . 


(4)  Long-distance  calls  made  on  the  AUTOVON  network,  the  FTS  system,  WATS 
lines,  and  FX  lines  do  not  appear  on  the  telephone  company  listings  and, 
therefore,  are  excluded. 


b.  Each  telephone  call  is  either  official  or  unofficial.  An  official  call 
is  one  in  which  government  business  is  transacted.  IAW  AR  105-23,  if  a  toll 
call  is  not  recorded  on  the  DA  Form  360,  where  required,  it  is  circled  by  the 
TCO  and  returned  to  the  C-E  officer  for  followup.  These  calls  are  considered 
to  be  unverified,  or  in  sampling  plan  parlance,  defectives.  The  number  of 
defectives  in  a  sample,  among  other  factors,  determine  the  acceptability  of  the 
population.  This  decision  is  unaffected  by  subsequent  findings  that  the  call 
was  indeed  an  official  call  or  was  erroneously  charged  by  the  telephone 
company. 


c.  The  statistical  sampling  plan  approach  to  toll  call  certification  can 
be  implemented  by  a  variety  of  attribute-type  sampling  plans.  Attribute  plans 
are  those  in  which  a  sampled  item  is  either  good  or  bad;  e.g.,  the  toll  call 
being  audited  is  either  official  or  it  is  not.  DOD  reconmends  the  sampling 
plans  and  procedures  of  MIL-STD-105D,  but  other  types  and  variations  are 
readily  available  that  can  be  used  with  proper  approval. 
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d.  The  MH-STD-105D  sampling  plans  are  designed  to  provide  levels  of 

protection  against  wrong  decisions  for  a  range  of  population  sizes  by  defining 
the  sample  size  required  and  the  number  of  sampled  units  that  are  allowed  to  be 
defective  in  the  sample,  and  yet  permit  acceptance  of  the  population.  * 

Figure  3-1  presents  MIL-STD-1Q5D  sampling  plans  that  apply  to  the  population 
sizes  found  in  toll  call  certification.  The  basic  assumptions  upon  which  the 
statistical  probabilities  rely  are  that  (1)  the  process  that  generates  the 
population  is  in  a  controlled  condition,  and  (2)  the  sampled  units  are  selected 
in  a  random  and  representative  manner.  Figure  3-2  describes  the  procedure  for 
MIL-STD-105D  sampling  plans.  The  cost  impact  of  defective  units  can  be  used  to 
establish  the  acceptance  criteria,  as  noted  in  paragraph  3n(2)  wherein  major 
defectives  or  equivalent  major  defectives  are  counted.  Three  levels  of 
sampling  plans  are  listed:  tightened,  normal,  and  reduced.  When  the  sampling 
plans  are  first  introduced,  the  normal  level  is  used.  Then,  if  population 
quality  deteriorates,  the  tightened  level  is  used,  or  if  it  demonstrates 
continued  high  quality,  the  reduced  level  is  used.  Figure  3-3  shows  how 
sampling  results  dictate  the  sampling  levels  to  be  used. 

e.  Another  sampling  technique  used  is  chain  sampling.  This  system  makes 
use  of  the  cumulative  results  for  samples  from  the  current  and  previous  months. 
The  procedures  achieve  protection  against  wrong  decisions  comparable  to  that  of 
MIL-STD-105D,  but  with  reduced  sample  size.  It  also  has  the  built-in  feature 
of  inmediate  response  to  varying  population  trends.  Figure  3-4  describes  the 
procedure  for  the  typical  chain  sampling  plan. 

f.  The  statistical  sampling  plans  which  approach  periodic  monitoring  are 
called  skip-lot  sampling  plans.  As  the  name  implies,  one  or  more  monthly  toll 
call  bills  can  be  certified  without  audit  based  upon  a  superior  history  of 
control.  Figure  3-5  presents  the  characteristics  of  these  sampling  plans. 

g.  The  protection  afforded  by  statistical  sampling  plans  against  wrong 
decisions  are  depicted  by  Operating-Characteristic  (0-C)  curves.-  The  ordinate 
of  these  curves  is  the  probability  of  acceptance;  the  abscissa  is  the  incoming 
percentage  defective  of  the  lots  {monthly  toll  call  listing).  Each  point  on 
the  curve  defines  the  probability  of  acceptance  for  the  percent  defective  of 
the  population  being  offered  for  review.  Two  points  on  this  curve  are  used  to 
describe  what  is  the  allowable  percent  defective,  defined  by  the  Acceptable 
Quality  Level  (AQL),  and  what  is  the  unacceptable  percent  defective.  The 
percent  defective  with  a  probability  of  acceptance  of  0.95  is  defined  as  the 
AQL;  the  percent  defective  with  probability  of  acceptance  of  0.10  is  termed  the 
Lot  Tolerance  Percent  Defective  (LTPD).  The  shape  of  the  curve  is  established 
by  the  sample  size  and  the  number  of  defectives  in  the  sample  that  is  allowed 
for  lot  acceptance.  The  0-C  curve  is  the  device  used  to  show  when  different 
sampling  methods  afford  identical  risk  control.  Figure  3-6  shows  how 
MIL-STD-105D  sampling  plans  are  equivalent  to  chain  sampling  plans. 

% 

h.  The  level  of  control  evidenced  by  an  Army  install ation/activi ty  must  be 
better  than  the  normal  level  sampling  plan  LTPD  for  sampling  procedures  to  be 
used.  When  the  level  of  control  reaches  the  AQL  percentage  or  less,  a  skip-lot 
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Figure  3-1:  MIL-STD-105D  Attribute  Single  Sampling  Plans  where  n=samp!e  size 
AOacceptance  number,  RE=rejection  number 
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*If  the  AC  is  exceeded,  but  the  RE  has  not  been  reached,  accept  the  toll  call 
population,  but  reinstate  normal  sampling  review  on  the  next  month’s 
popul  ation. 
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3-2:  Single  Sample  Procedure  to  Determine  Toll  Call  Population 
Acceptability 


<4 


Review  sample  of  n  toll  calls 


If  the  number  of  defective  toll  calls  found 


Does  not  exceed 
the  quantity  AC 


7  r 

Certi  fy  the 
remaining  toll 
cal  Is  in  the 
popul  ation 


i 

i  »* 

Exceeds  the  AC 
quantity  but  is 
less  than  the  RE 
quantity 


7 

Return  to 
normal  level 
sampl i ng  pi  an 


7 

|  Equals  or  exceeds 
I  the  quantity  RE 


7 

Review  all  the 
remaining  toll 
call s  i n  the 
popul  ation 
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COMPARISON  OF  OC  CURVES  FOR  LOT  SAMPLING  it  CHAIN  SAMPLING 


INCOMING  PERCENT  DEFECTIVE 


type  sampling  plan  can  be  used.  Figure  3-7  shows  the  0-C  curves  for  the 
normal,  tightened,  and  reduced  levels  to  indicate  the  variation  in  risk  levels. 

i.  Three  different  AQls  are  presented  in  this  study:  1.5  percent,  2.5  * 
percent,  and  4.0  percent.  The  sampling  plans,  0-C  curves,  and  related  sampling 
plan  characteristics  are  shown  in  figure  3-8  for  the  range  of  lot  sizes  that 
occur  in  the  toll  call  certification  process. 

j.  The  use  of  sampling  methods  requires  a  study  be  made  to  determine 

(1)  the  level  of  control  that  exists  with  respect  to  toll  call  certification, 
and  (2)  the  amount  of  economics  that  result  from  the  procedures  to  be  used.  A 
simple  control  chart  should  be  instituted  with  upper  and  lower  limits  to  track 
the  population  trends.  In  addition,  the  unofficial  calls  observed  must  be 
documented  along  with  the  corrective  action  followup  taken.  If  the  level  of 
control  that  is  found  permits  initiating  a  sampling  program,  the  control  chart 
should  be  continued  to  monitor  status  for  the  subsequent  toll  call  bills.  If 
the  level  does  not  yet  permit  sampling,  the  control  chart  serves  as  a 
management  tool  to  direct  actions  that  will  eventually  allow  the  application  of 
sampling.  The  data  for  the  control  chart  should  include  the  following 
el ements: 

(1)  Sampling  plan  used  (or  100  percent  audit). 

(2)  Number  of  toll  calls  sampled,  including: 

Originators  number. 

Number  called. 

Duration. 

Charge. 

Organization. 

Audit  result  (unofficial  or  certified). 

Followup  started  on  unofficial  toll  calls  and  date  started. 

(3)  Total  toll  calls  on  bill. 

(4)  Total  dollar  value  of  the  toll  calls. 

(5)  Auditors  name  and  audit  date(s). 

k.  The  selection  of  the  sample  must  be  random  and  representative  of  the 
popul ation. 

(1)  To  ensure  randomness,  the  toll  calls  to  be  audited  should  be  selected 
based  upon  objective  procedures  such  as  applying  the  tables 'of  random  numbers. 
To  assure  representativeness,  the  population  may  be  subdivided  into  subgroups, 
with  similar  characteristics  (reflecting  organizational  entities,  toll  charge 
groups,  etc.)  with  random  samples  drawn  from  the  subgroups.  One  way  to  use  a 
random  numbers  table  for  toll  call  sampling  is  to  use  the  toll  call 
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identification  provided  by  the  format  of  the  telephone  company  listing:  page 
number  and  item  number  of  the  page.  Enter  the  random  table  in  some  objective 
manner,  such  as  at  the  point  of  a  dropped  pencil,  toss  a  coin  to  decide  to 
proceed  up  or  down  the  column,  and  use  the  first  two  digits  of  the  table  for* 
the  page  number  and  the  third  for  the  item  number  of  the  page  to  form  a  list  of 
the  toll  calls  to  be  sampled. 

(2)  Another  technique  is  to  decide  before  hand  on  some  arbitrary 
assignment  of  numbers  to  constitute  the  sample.  A  variation  of  this  method  is 
to  divide  the  lot  into  a  number  of  segments  and  then,  before  sampling,  decide 
on  the  number  of  samples  to  be  taken  from  each  segment. 

l.  The  sample  size  is  determined  by  the  maximum  tolerable  error  and 
confidence  levels  that  are  established  by  mangement  for  the  costs  involved. 
Stratification  of  the  population  is  a  device  for  limiting  sampling  to 
significant  costs  which  may  exclude  the  high  cost  toll  call  charges. 

m.  Selected  samples  are  audited  to  determine  if  they  are  toll  calls  of  an 
official  nature  using,  but  not  limited  to,  the  criteria  described  in  paragraph 
3a.  The  audit  should  look  into  any  questionable  DA  Form  360  entries  to  confirm 
that  they  are  indeed  official  toll  calls. 

n.  Sampling  plan  acceptance  criteria: 

(1)  The  sampling  plan  may  specify  the  acceptance  criteria  for  the 
population  based  upon  defectives  in  the  sample.  If  the  number  of  defectives 
does  not  exceed  the  acceptance  criteria,  the  population  is  considered  to  be 
certified.  The  estimated  dollar  value  of  defectives  in  the  portion  of  the 
population  is  estimated  from  the  formula: 

C  -*  N  x  D 
n 

where: 

C  ■  Estimated  dollar  value  of  invalid  toll  call  charges 
expected  to  remain  in  the  certified  population. 

N  »  Number  of  toll  calls  in  the  population. 

n  »  Number  of  toll  calls  in  the  sample. 

D  *  Total  dollar  value  of  the  toll  call  charges  in  the  unverified 
toll  calls  found  in  n. 

(2)  The  sampling  plan  may  specify  the  acceptance  criteria  for  the 
population  based  upon  major  defectives  in  the  sample.  Defectives  are  classed 
as  major  defectives  or  minor  defectives  based  upon  their  toll  call  charges. 
Population  acceptability  is  established  on  the  basis  of  major  defectives  where 
two  ore  more  minor  defectives  are  combined  to  constitute  an  equivalent  major 
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defective.  Another  variation  for  evaluating  defectives  is  to  define  a  standard 
dollar  value  as  a  major  defective.  Then  add  up  the  dollar  values  of  all 
defectives  found  in  the  sample.  Divide  the  total  by  the  standard  dollar  value 
to  determine  the  number  of  equivalent  major  defectives.  Compare  the  number  of 
major  defectives  and  partial  major  defectives  to  the  sampling  plan  acceptance 
criteria. 

4.  SAMPLING  PLAN  COST  ANALYSIS. 

a.  The  application  of  statistical  sampling  procedures  is  dictated  by  the 
prospect  of  gaining  economies.  Real  savings  in  personnel  cost  obtain  only  when 
the  time  saved  can  be  used  advantageously  or  where  staff  reductions  can  be 
made.  Sampling  methods  may  be  used  also  where  better  systems  and  management 
control  resul t  without  additional  costs. 

b.  The  costs  associated  with  implementing  and  continuing  a  sampling  system 
should  not  exceed  the  savings  that  accrue.  Costs  incurred  are  categorized  as 
nonrecurring  costs  and  as  recurring  costs. 

c.  Nonrecurring  costs.  Figure  4-1  sunmarizes  the  costs  that  are 
encountered  when  implementing  a  sampling  system.  These  costs  are  estimated  to 
be  approximately  $1,000,  an  amount  that  will  be  covered  within  the  first  few 
months  of  any  sampling  program.  Nonrecurring  cost  effort  includes  the 

foil owi ng: 

(1)  Perform  an  economic  analysis  of  the  various  alternatives  for 
accomplishing  toll  call  certification.  Costs  of  assimilating  historical  data 
(number  of  toll  calls,  number  of  unofficial  calls,  costs  of  unofficial  vs. 
official  toll  calls,  characteristics  of  unofficial  toll  calls,  followup  of 
unverified  calls,  management  reports,  historical  records)  are  not  unique  to 
sampling  programs  as  they  are  requirements  of  AR  105-23  now. 

(2)  Have  the  Cost  Validation  Center  (CVC)  validate  the  economic  analysis 
I AW  ASR  37-3. 

(3)  Document  and  approve  the  sampling  program  plan  and  the  detailed 
implementing  procedures 

(4)  Indoctrinate  the  operating  personnel  in  the  provisions  of  the  sampling 
program  plan  and  the  detailed  implementing  procedures.  Only  those  personnel 
who  have  received  this  training  should  be  allowed  to  direct  or  participate  in 
the  sampling  operations. 

(5)  Miscellaneous  expenses  include  providing  worksheets,  forms,  training 

materials,  and  special  equipment  used  for  sorting  toll  call  information  when 
defining  the  population  to  be  sampled.  » 

d.  Recurring  costs.  Figure  4-2  sunmarizes  the  costs  that  are  encountered 
after  a  sampling  system  has  been  implemented.  Figure  4-3  indicates  the  monthly 
savings  that  can  be  realized  for  a  range  of  lot  sizes  when  the  sampling  program 
is  operating.  Recurring  cost  effort  includes  the  following: 
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Figure  4-1.  Nonrecurring  Sampling  System  Costs 


Perform  an  economic  analysis 
(EA)  of  alternatives 


Validate  the  EA  savings 

Document  sampling  program 
pi  an  and  procedures 

Indoctrinate  personnel 

Miscellaneous 
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Labor 

Grade 

Labor 

Rate/Hr 

Estimated 

Hours 

Cost 

GS-7 

$11.90 

20-40 

$  238-476 

GS-11 

17.62 

4-8 

70-141 

GS-9 

14.56 

8-24 

117-350 

GS-11 

17.62 

2 

35 

120 

Total 

$580-1,122 

Figure  4-2.  Recurring  Sampling  System  Costs/Month 


Define  population 
to  be  sampled 

Select  sample 
0.48/call 


Labor 
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GS-3 


Audit  the  sampled  toll  calls 
0. 22/call 


Document  audit  findings  GS-3 


Evaluation  cost  of  the 
undetected,  unofficial  toll 
calls  in  the  population 


Labor 

Rate/Hrs 

$7.85 


Estimated 

Hours 

4 


7.85  4 


Cost 

$30.61 
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TOLL  CALL  CERTIFICATION  COST  SAVINGS  FROM  SAMPLING 
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NUMBER  OF  TOLL  CALLS  REVIEWED  PER  MONTH 
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(1)  Define  the  population  to  be  sampled.  Paragraph  3a  describes  some 
cases  where  toll  calls  are  excluded  from  the  population  to  be  sampled.  When 
stratif ication  is  employed,  the  toll  call  population  is  divided  into  subgroups, 
some  of  which  may  be  sampled,  while  others  are  audited  100  percent  or  not  at-1 
all.  This  segregation  process  can  be  accomplished  either  manually  or  by  data 
processing  equipment. 

(2)  Select  the  sample  to  be  reviewed  and  perform  the  audits.  The 
sample  selection  process  is  critical,  but  need  not  be  a  time-consuming 
operation.  The  detailed  procedures  should  specify  the  methods  to  be  used,  as 
indicated  in  paragraph  3k.  These  methods  are  tailored  to  fit  the  particular 
organization's  situation.  The  audit  determines  if  the  sampled  toll  calls  are 
official  or  unofficial  according  to  the  guidelines  of  paragraph  3a. 

(3)  Document  the  audit  findings,  including  the  data  listed  in 
paragraph  3j. 

(4)  Estimate  the  dollar  value  of  undetected  unofficial  toll  calls  in 
the  portion  of  the  population  that  was  not  audited,  where  the  population  is 
accepted  on  a  sampling  basis.  One  simple  technique  to  use  is  described  in 
paragraph  3n. 

(5)  Where  the  population  is  not  accepted  because  the  sampling  plan 
acceptance  criteria  is  exceeded,  the  population  may  be  screened  100  percent  or 
only  some  portion  thereof  may  be  audited.  The  followup  action  should  be 
delineated  in  the  sampling  program  plan. 

e.  The  number  of  toll  calls  needed  to  be  reviewed  in  order  to  certify  the 
toll  call  population  depends  upon  the  unofficial  toll  call  percentage  in  the 
population  and  the  followup  action  taken  when  an  acceptance  decision  cannot  be 
made.  Figure  4-4  shows  the  cumulative  average  sample  number  based  upon  the 
followup  action  to  review  all  of  the  toll  calls  in  the  population  in  event  of  a 
reject  decision  based  on  sample  results.  Perhaps  a  more  enlightened  approach 
to  the  remaining  population  is  to  concentrate  on  those  areas  where  problems 
were  found.  The  quantity  to  review  under  this  approach  then  lies  somewhere 
between  the  sample  size  and  the  total  quantity  in  the  population,  as  shown  in 
figure  4-4. 

f.  A  stratification  approach  will  provide  control  of  the  costs  associated 
with  the  payment  of  unofficial  toll  calls  that  remain  undetected  in  the 
population  when  it  is  accepted  by  a  sampling  procedure.  This  requires  a  100 
percent  review  of  the  high  cost  toll  calls,  or  because  cost  derives  from 
distance  and  duration,  either  of  these  factors  may  be  used  too.  Paragraph 

2c ( 5 )  highlights  the  benefits  of  stratifying  by  cost/toll  call.  Checking  all 
of  the  high  cost  toll  calls  eliminates  them  as  possible  contributors  to  the 
cost  of  undetected  unofficial  calls.  Figure  4-5  presents  a  truncated  histogram 
of  telephone  calls  from  an  organization  in  which  the  calls  of  duration  of  10 
minutes  or  less  have  been  eliminated.  This  may  suggest  that  any  call  under  10 
minutes  in  duration  will  not  be  audited  and  previous  experience  that  unofficial 
calls  are  usually  longer  in  duration.  Applying  a  100  percent  review  of  all 
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AVERAGE  T07RL  NUMBER  OF  TOLL  CRLLS  REVIEWED  (flTR) 


PERCENT  OF  TOLL  CRLLS  IN  POPULATION  THAT  ARE  UNOFFICIAL 


Figure 


calls  of  25  minutes  or  more  eliminates  the  higher  cost  undetected,  unofficial 
calls.  The  population  subject  to  sampling  then  consists  of  those  calls  between 
10-25  minutes  in  duration.  The  costs  thus  bounded  will  minimize  the  costs  of 
undetected,  unofficial  calls.  4 

5.  RECOMMENDATIONS: 

a.  With  the  cooperation  of  the  C-E  officer  at  Fort  Hood,  conduct  a  trial 
run  applying  sampling  methods  to  certify  toll  calls.  This  action  should  serve 
the  twofold  purpose  of  developing  text  to  revise  AR  105-23,  as  well  as  setting 
up  a  sampling  certification  program  at  Fort  Hood.  Fort  Hood,  and  possibly  Rock 
Island,  have  sufficient  workload  and  exhibit  adequate  control  to  consider 
adopting  such  a  program.  The  other  installations/activities  reviewed,  eight 
installations  and  tHe  recruiting  command  activity,  are  not  ready  to  introduce 
sampling  methodology. 

b.  Request  that  the  Army  audit  agencies  (IG,  AAA,  etc.)  include  reviews  of 
telephone  usage  records  and  practices  to  evaluate  the  adequacy  of  controls  and 
to  highlight  the  telephone  abuse  problem.  It  is  estimated  that  up  to  40 
percent  of  the  calls  made  are  unofficial  in  nature.  The  limited  survey  made  in 
this  study  showed  a  wide  variation  in  percentage  of  toll  calls  that  are 
determined  to  be  unofficial.  The  lack  of  response  and  the  partial  responses 
from  some  locations  in  this  study  imply  that  the  fundamental  data  needed  to 
assess  the  unofficial  usage  of  telephone  service  is  unavailable  there.  Audit 
reports  published  by  the  Navy  show  that  this  area  is  receiving  considerable 
attention. 

c.  Perform  economic  analyses  at  Army  installations/activities  to  examine 
the  various  alternatives  that  might  be  used  to  accomplish  toll  call 
certification.  This  action  forms  the  basis  for  justifying  sampling  methods  and 
other  time/cost  savings  opportunities.  It  also  defines  the  magnitude  and 
nature  of  the  telephone  abuse  problem  to  guide  corrective  measures,  which  when 
implemented,  should  enable  some  form  of  stratified  approach  to  certification  at 
each  location.  Typical  alternatives  to  investigate  are  described  in  table  5-1. 

d.  Use  MIL-STD-105D  single  sampling  plans  where  statistical  sampling  plans 
are  justified.  Before  instituting  these  plans,  the  analysis  to  justify  the 
program  should  be  reviewed  by  an  independent  agency  to  confirm  the  projected 
savings  and  other  benefits. 

e.  Define  the  sampling  plan  risks  to  be  as  follows: 

(1)  The  toll  call  population  is  acceptable  for  certification  where 

5  percent  of  the  calls  are  unofficial;  this  corresponds  to  Acceptable  Quality 
Levels  (AQL)  of  up  to  5  percent  for  any  sampling  plan. 

(2)  The  toll  call  population  is  acceptable  for  certification  if  less  that 
1  percent  of  the  total  toll  call  charges  remaining  in  the  telephone  bill  when 
it  is  paid  are  for  unofficial  calls. 
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Table  5-1.  Toll  Call  Certification  Alternatives 


1.  Management  Control s .  Establish  rules  and  policies  to  cover  AR  105-23  •* 

impact  within  the  organization.  Check  to  see  that  the  system  of  control  is 
operating  effectively.  Utilize  the  audit  services  of  the  Army  (IG,  AAA,  USAREC 
brigade  level  inspection  teams,  etc.).  Discipline  those  found  to  be  abusing 
the  access  to  telephones.  Maintain  visibility  of  costs,  institute  budgetary 
controls,  and  incentives/penalties.  Certify  the  toll  calls  on  a  purely 
spotcheck  basis. 

2.  Controlled  Access.  Route  all  toll  calls  through  an  operator  for 
accountabi li ty .  Route  calls  during  off-duty  hours  through  an  operator.  Limit 
telephone  service  outside  of  the  i nstall ation/acti vity  to  certain  individuals 
or  grade  levels.  Lock  up  phones  when  unattended. 

3.  100  Percent  Audit.  Check  all  toll  calls  in  the  telepohone  bill  with  the 
documentation  required  by  AR  105-23  or  admi  ni  strati  ve  directives.  For 

i  nstall  ations/acti  vi  ti  es  with  a  small  nunber  of  toll  calls  per  month  (150  or 
less),  this  is  the  preferred  method. 

4.  Random  Sampl  i  ng .  When  justified,  accomplish  toll  call  certification  by  an 
approved  statistical  sampling  program.  The  sampling  plans  should  provide  the 
flexibility  to  react  to  population  trends  so  that  increases  in  telephone  misuse 
are  met  with  tightened  requi rements ,  and  problem- free  history  justifies  greater 
risks  through  reduced  requi  rements .  Where  stratification  is  practiced, 
different  subgroups  can  be  subject  to  the  sampling  acceptance  criteria 
appropriate  to  their  particular  circumstances.  In  this  way,  costs  can  be 
minimized  and  effort  can  be  directed  to  those  subgroups  requiring  attention. 

5.  Status  Monitoring.  Review  questionable  toll  calls,  ones  that  are  high 
cost,  long  duration,  nave  an  unusual  destination,  are  made  at  unusual  times, 
emanate  from  new  activities  on  the  installation,  are  repeatedly  made  to  the 
same  destination,  or  have  been  problems  before.  This  approach,  although  not  a 
statistically  sound  sampling  approach,  should  be  used  to  supplement  other 
alternatives.  Where  historical  evidence  indicates  that  the  dollar  value  of 
unofficial  toll  calls  is  very  low  (I  percent  or  less  of  the  total  toll  call 
billing),  status  monitoring  should  suffice  as  the  certification  method. 

6.  Stratified  Audits.  Stratify  the  population  of  toll  calls  into  subgroups 
and  certify  the  tod  calls  from  the  subgroups  as  noted  below: 

a.  Stratify  the  population  based  upon  economic  considerations.  All  high 
cost  toll  calls  should  be  reviewed.  Unofficial  toll  calls  often  are  the  high 
cost  calls,  as  was  found  in  the  survey  of  Army  Installations.  Moreover,  the 
elimination  of  the  high  cost  unofficial  toll  calls  from  populations  that  are 
accepted  by  sampling  is  a  means  of  controlling  the  erroneous  payment  of 
undetected  unofficial  toll  calls.  On  the  other  hand,  it  is  not  cost-effective 
to  review  the  insignificant  cost  toll  calls.  Significant,  but  not  high  cost 


Table  5-1.  Toll  Call  Certification  Alternatives  (Cont) 

toll  calls  then  constitute  a  subgroup  which  may  be  subject  to  sampling  or  som£ 
form  of  status  monitoring  to  establish  certification. 

b.  Stratify  to  isolate  questionable  calls  of  the  telephone  company 
listing.  Review  only  the  questionable  toll  calls  or  perform  some  form  of 
sampling  on  the  remainder. 

c.  Stratify  by  organizational  entities  or  other  responsible  jurisdictions 
Certify  the  toll  calls  of  each  with  appropriate  methods  in  consideration  of 
their  past  history,  message  recording  equipment,  and  other  relevant  factors. 

d.  Stratify  by  separating  known  problem  areas  from  problem-free  areas. 
Apply  100  percent  audits  or  tightened  inspection  levels  on  the  toll  calls  of 
the  former  and  appropriate  methods  on  the  latter. 

e.  Stratify  with  combinations  of  the  above.  For  example,  perform  100 
percent  audit  of  high  cost  calls,  questionable  calls,  and  known  previous 
problem  areas,  and  sample  the  remainder  to  establish  certification. 
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f.  Update  AR  105-23  to  acknowledge  that  statistical  sampling  methods  can 
be  used  to  accomplish  certification  of  toll  charges.  The  following 
requirements  should  be  defined  when  statistical  sampling  methods  are  used: 
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(1)  A  study  must  be  made  that  will  provide  evidence  that: 

(a)  The  toll  call  population  to  be  sampled  exhibits  adequate  control  with 
regard  to  level  of  conformance  and  month- to-month  variability  over  a  period  of 
time  no  less  than  6  months. 

(b)  The  certification  plans  will  result  in  economies  over  a  period  of  2 
years  or  less. 

(c)  There  is  an  overall  program  to  maintain  visibility  and  control  of 
unverified  toll  calls,  to  react  to  adverse  trends,  and  to  enable  reduced 
sampling  levels,  were  appropriate. 

(2)  The  analysis  and  conclusions  of  the  study  will  be  subject  to 
validation  by  the  cost  validation  center  (CVC). 

(3)  The  certification  program  must  be  documented  by  the  installation/ 
activity  and  approved  by  HQ,  7th  Signal  Command,  or  their  delegate.  The 
program  should  establish: 

(a)  Responsibilities. 

(b)  Sampling  plan  procedures. 

(c)  Sample  selection  methodology. 

{ d )  Corrective  action  policy. 

(e)  Data,  records,  and  management  reports. 

(f)  Periodic  audit  and  survey  provisions. 

(g)  Guidelines  for  the  program  plan.  These  could  be  given  in  appendices 
to  AR  105-23  to  be  lifted  word-for-word  into  the  program  plan. 

(4)  Control  charts  must  be  maintained  to  track  progress  and  status  to 
justify  continued  sampling  operations  and  reduced  levels,  where  applicable. 
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